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CLAIMS 

1. An image processing method for obtaining a glassless image from a color 

frontal facial image bearing glasses, comprising the steps of: 
5 a) receiving an RGB color frontal facial image bearing glasses, wherein 

RGB are red-, green-, and blue-component contained in the received RGB color 
frontal facial image; 

b) extracting candidates of eye regions from the received RGB color frontal 
facial image; 

10 c) determining an exact eye region out of the candidates and normalizing the 

received RGB color frontal facial image in a predetermined size by centering on the 

determined eye region; 

d) extracting a glasses frame region by using color information contained in 

the received RGB color frontal facial image and edge information of a glasses frame; 
15 e) performing an RGB-HSI transformation on the normalized frontal facial 

image;- 

f) generating H\ S', and V glassless compensated images on the basis of the 
RGB-HSI transformed H-, S-, and I-component normalized frontal facial images, 
wherein the H-, S-, and I-component represent a hue, a saturation, and an intensity, 

2 0 respectively; 

g) obtaining R', G\ and B 1 compensated images by performing an HSI-RGB 
transformation on the H\ S\ and T glassless compensated images; and 

h) creating a glassless final color facial image on the basis of the R\ G', and 
B' compensated images, 

2 5 wherein the step f) further comprises the steps of: 

fl) obtaining H-, S-, and I-component reconstructed images by 
reconstructing the H-, S-, and I-component normalized frontal facial images; 

f2) obtaining H-, S-, and I-component first differential images between the 
H-, S-, and I-component normalized frontal facial images and the H-, S-, I- 

3 0 component reconstructed images; 

f3) obtaining H-, S-, and I-component second differential images by 
stretching H-, S-, and I-component first differential images on the basis of pixel 
information contained in the H-, S-, and I-component first differential images; 

f4) determining thresholds to classify the H-, S-, and I-component second 
3 5 differential images into occlusion regions, non-occlusion regions, and uncertain 
regions; 
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f5) obtaining an I-component third differential image by including the 
extracted glasses frame region onto the uncertain region classified by the threshold 
within the I-component second differential image; 

f6) classifying the H- and S-component second differential images and the I- 
5 component third differential image on the basis of the thresholds to determine a 
weight to be applied on the respective classified images; and 

f7) obtaining the H\ S\ and T compensated images by applying the weight 
on each of the H- and S-component second differential images and the I-component 
third differential image. 

10 

2. The image processing method of Claim 1, wherein the H-component 

normalized frontal facial image is expressed as H x - and H y -vector-component 

images as follows: 

H = cos(//) 

15 

H y =sin(H) 

wherein H' x and H' y compensated images are obtained on the basis of the H x - 
and //^-vector-component images. 

2 0 3. The image processing method of Claim 2, wherein the H-component 

glassless compensated image is obtained from the H' x and H' y compensated 

images as follows: 

yl H 'x + h 'y 2 
H' = co$-\H" x ) 

25 

wherein H" x is obtained by normalizing H' x with (H'x+H'y 2 )^. 




4. The image processing method of Claim 1, wherein the H\ S\ and V 
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compensated images are obtained by a principal component analysis (PCA) 
reconstruction, and 

the step c) further comprises the steps of: 

cl) obtaining first and second transformed images on the basis of color 
5 information contained in the received RGB color frontal facial image; and 

c2) normalizing the received RGB color frontal facial image by using the 
first and second transformed images. 

5. The image processing method of Claim 4, wherein the first and second 

1 0 transformed images are a generalized skin color distribution (GSCD) image and a 
black and white color distribution (BWCD) image, respectively. 

6. The image processing method of Claim 5, wherein the color information is 
gray-level pixel information. 

15 

7. The image processing method of Claim 5, wherein the stretching at step f3) 
is performed as follows: 

D(i) = (hQd(i)Y 2 

2 0 wherein D(i) represents the H-, S-, and I-component second differential images, 

f (0 represents the H-, S-, and I-component reconstructed images generated during 

performing the PCA reconstruction, d(i) represents the H-, S-, and I-component first 
differential images, and i is an index for indicating pixels in each image. 

2 5 8. The image processing method of Claim 5, wherein the occlusion regions 

contain the glasses and errors due to a reflection and shade by the glasses within the 
received RGB color frontal facial image. 

9. The image processing method of Claim 8, wherein the step f4) further 

3 0 comprises the steps of: 

inversing the first transformed image; 

performing an OR operation on the inversed first transformed image with 
the second transformed image; 

determining an average of errors within the OR operated image as a lower 
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threshold; and 

determining an average of errors greater than the lower threshold within the 
OR operated image as an upper threshold. 

5 10. The image processing method of Claim 9, wherein the upper and lower 
thresholds are determined as follows: 

T L =mean(D(j)), 
where, j e skin region 
T H = mean{D(k)), 

where, k e {j\D(j) > T L } j e non - skin region 

wherein T L and T H represent the lower and upper thresholds, respectively, D(j) 
represents errors of skin regions corresponding to the non-occlusion regions within 
the H-, S-, and I-component second differential images, and D(k) represents errors 
of non-skin regions corresponding to the occlusion regions within the H-, S-, and I- 
component second differential images. 

11. The image processing method of Claim 10, wherein the occlusion regions in 
the I-component second differential image includes the glasses frame region, which 
is extracted as follows: 

If,D(0<r„ 
then 

D'(Q = max(D(i),G(Q), 
2 0 where, i = !.,•••, AT 

if 9 D(f)*T„ 
then 

D\i) = D{i) 

wherein the I-component third differential image is obtained on the basis of the I- 
component second differential image including the glasses frame region, D'(i) 
represents the I-component third differential image, and G(i) represents gray-level 
2 5 values of the extracted glasses frame region. 

12. The image processing method of Claim 11, wherein the weights are 
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determined as follows: 

If,D'(/)>r„ 
then 
aKi) = 1 

\i,T L <D\i)<T H 
then 

<a(i) = l-0.5 " _ r w 
else 

<y(0 = 0 

5 wherein a weight of 1 is applied on regions having error values greater than the upper 
threshold within the I-component third differential image, a weight of 0 on regions 
having error values less than the lower threshold, and a weight with a value from 0.5 
to 1 on regions having error values between the upper and lower thresholds, and 

wherein the regions having the error values greater than the upper threshold 
1 0 are the occlusion regions, the regions having the error values less than the lower 
threshold are the non-occlusion regions, and the regions having the error values 
between the upper and lower thresholds are the uncertain regions. 

13. The image processing method of Claim 12, wherein the occlusion regions 
15 within the I-component third differential image are compensated as follows: 

If (t = 0) 
then 

rT(0 = a> -?>+(l-<y).r(0 
else 

r t {i)=co f,(o+(i-*>) r(o 

wherein represents the T compensated image, O) represents the weights, (p 

2 0 represents an I-component average image, r, (/) is the I-component reconstructed 
image, and is the I-component normalized frontal facial image. 

14. The image processing method of Claim 10, wherein a weight of 1 is applied 

-23- 




•PCT/KR03/00927 
RO/KR 31. 12. 2003 

on regions having error values greater than the upper threshold within the H- and S- 
component second differential images, a weight of 0 on regions having error values 
less than the lower threshold, and a weight with a value from 0.5 to 1 on regions 
having error values between the lower and upper threshold, 
5 wherein the regions having the error values greater than the upper threshold 

are the occlusion regions, the regions having the error values less than the lower 
threshold are the non-occlusion regions, and the regions having the error values 
between the upper and lower thresholds are the uncertain regions. 

10 15. The image processing method of Claim 14, wherein the occlusion regions 
within the H- and S-component second differential images are compensated as 
follows: 

If (f = 0) 
then 

iT(0=tf> ^+(i-a» r(/) 

else 

r,'(o = a> .f,(o+(i-^)-r(o 

15 

wherein represents the FT and S' compensated images, co represents the 

weights, (p represents H- and S-component average images, Y t (i) is the H- and S- 

component reconstructed images, and Y{i) is the H- and S-component normalized 
frontal facial images. 

20 

16. The image processing method of Claim 13 or 15, further comprising the step 
of repeating the steps fl) to f7), 

wherein the H\ S\ and I' compensated images obtained at step f7) are used 
at step f 1) instead of the H-, S-, and I-component normalized frontal facial images 

2 5 when performing the repeating step. 

17. The image processing method of Claim 16, further comprising the steps of: 
determining whether each difference between the H\ S\ and T compensated 

images obtained at step f7) and H\ S\ and T compensated images obtained after 

3 0 performing the repeating step is less than the predetermined value or not; 

performing, if each difference is less than the predetermined value, the HSI- 
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RGB transformation on the H', S\ and I' compensated images obtained after 
performing the repeating step, to thereby obtain the glassless final color facial image 
based on the transformed H', S\ and I 1 compensated images obtained after 
performing the repeating step; and 
5 performing the repeating step, if each difference is greater than the 

predetermined value. 
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